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(54) Image attribute altering device and electronic watermark embedding device 



(57) Image attribute detection means (102) for 
detecting the attribute of an input image (101) attribute 
"A") and image attribute altering means (104) for alter- 
ing the image attribute in the input image (101) on the 
basis of the attribute detection result (103) of the input 
image (101) are provided to output an output image 
(105) having a new attribute (attribute "B"). The image 
attribute detection means (102) includes first DCT 
means for subjecting the input image to discrete cosine 



transform to obtain frequency components, second 
DCT means for subjecting the original image to discrete 
cosine transform to obtain original frequency compo- 
nents, and means of subtracting the original frequency 
components from the image frequency components and 
dividing the subtraction result by the image frequency 
components to detect the electronic watermark data 
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Description 

BACKGROUND OF Jf -fE INVENTIONj 
1 . Field of the Invention 

[0001 J The present invention relates to an image 
attribute altering device based on electronic watermark 
data, and particularly to an image attribute altering 
device based on electronic watermark data and an elec- 
tronic watermark embedding device for embedding 
(inserting) electronic watermark data in which copyright 
owner ship is authenticated, infringement of copyright is 
easily searched, and electronic watermark (which is 
also referred to as digital watermark) which is used tor i 
audio, images video, multimedia, etc. is applied to pro- 
vide specific attribute to electronically watermarked 
audio, images, etc., thereby restricting the copies of the 
audio, images, or so like. 

2. Description of the Related Art 

[0002] Recently, electronified media such as audio, 
images, video, multimedia, etc. have been increased, 
and also there has been required a guarantee system z 
which can easily check intellectual proprietary rights 
such as copyright etc. and data sources. An encryption 
system in which data are temporarily enciphered and 
only a proprietor can decipher the enciphered data is 
effective as a simple checking method as described at 
above, and a method of subjecting original media to 
electronic watermarking has been known as an encryp- 
tion system as described above 

[0003] Further, from the viewpoint of protecting the 
copyright, there has been generalized that an attribute sfi 
is provided to an original image to prohibit the original 
image from being copied or allow the original image to 
be copied only once or specific several times. 
[0004] In order to alter the attribute of the image as 
described above, an attribute to be embedded during a 4o 
vertical blanking period is generally altered. If the alter- 
ation of the attribute is allowed to be easily performed, 
the protection of the copyright cannot be sufficiently 
achieved. Accordingly it has been required to prevent 
unjust copy of digital images on the basis of specific 45 
restricting conditions. 

[0005] With respect to the attribute inserted during the 
vertical blanking period, it has been proposed in Japa- 
nese Laid-open Patent Application No. Hei-8-275127 
that an identification signal to be inserted during the ver- 
tical blanking period (which is referred to as "VBI sig- 
nar, Video ID" or the like. In the following description, it 
is referred to as "VBI signal") is used to prohibit or allow 
the copy of analog video signals of 525 line/60 field. The 
VBI signal is inserted into each of 20-th (first field) and 
283 rd (second field) horizontal periods (1 H) during a ver- 
tical blanking period in video signals of one frame, and 
20-bit reference and 20-bits digital signal are inserted 
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into an effective video signal area after a horizontal syn- 
chronous signal and a color burst signal. CGMS (Copy 
Generation Management System) information repre- 
senting copy allowance/prohibition is transmitted by 2 
5 bits of the 20-bit digital signai. 

[0006] The method of transmitting the CGMS informa- 
tion by using the VBI signal described above is applica- 
ble to analog signals such as 525-line standard video 
signals in NTSC system, 625-line standard video sig- 
o naJs in PAL system or high-definition video signals such 
as high-vision signals or the like. However, the VBI sig- 
nai is inserted to a predetermined place, and it can be 
easily removed by image processing such as filtering or 
the like, so that unjust copying of data cannot be pre- 
s vented. 

[0007] Therefore, there has been considered a 
method of embedding (inserting) electronic watermark 
data into an original image to prevent unjust use and 
unjust copy of the digital image. 
J [0008] Two kinds of watermark data, that is. visible 
electronic watermark data and invisible electronic 
watermark data are proposed as electronic data to dig- 
ital images. 

[0009] The visible electronic data is obtained by syn- 
r thesizing special characters or symbols for images so 
that the characters or symbols are visible; IHnduces 
deterioration of image quality, however, has such an 
effect that it makes a visible appeal to users of digital 
images to prevent unjust flow of the images. 
[0010] Japanese Laid-open Patent Application No. 
Hei-8-241403 discloses an embedding (inserting) man- 
ner of visible electronic watermark data. This publica- 
tion discloses a method of forming a electronic 
watermarked image, which comprises a step of supply- 
ing a digital original image, a step of supplying a digital 
watermark image, a step of forming a watermarked 
image by superposing the watermark image on the orig- 
inal image without altering chromaticity of pixels of the 
original image when the watermarking is earned out, 
thereby placing the visible watermark on the digital 
image. The electronic watermarked image forming step 
contains a step of correcting pixels corresponding to the 
original image by altering the brightness (not color) for 
each of pixels which are not "transparent" in the water- 
marked image. In this method, when the visible elec- 
tronic watermark data are combined with the original 
image In this method, the electronic watermark data are 
combined with the original-image so=that.only thetbright- 
ness of the pixels corresponding to the opaque portion 
of the electronic watermark data are varied and no color 
component is varied. At this time, the scaling value of 
the variation of the brightness component of the pixels 
is determined in accordance with the color component 
random number, the pixel value of the electronic water- 
mark data. The conspicuousness of the watermark is 
determined by the scaling value. 
[001 1 ] Further, the invisible electronic watermark data 
are embedded into the original image so that much 



14:53:40 



BP 0 957 637 A1 



attention is pad to prevention of deterioration in image 
quality, and it is visually insensible because it has little 
deterioration in image quality. 

[001 2] As described above, if specific information with 
which the identification of a copyright holder is enabled 5 
is embedded as the electronic watermark data, the cop- 
yright holder can be identified by detecting the elec- 
tronic watermark data even after an unjust copying is 
carried out. Further, if copy prohibiting information is 
embedded, when a reproducing device detects the to 
copy-prohibiting information, a user may be made to be 
informed of the fact that the data are copy-prohibited 
data, or a copy preventing mechanism in the reproduc- 
ing device may be drive to restrict the copy of the data 
to VTR or the like. /s 
[001 3] In order to embed the invisfcle electronic water- 
mark data into digital images, there is known a method 
of embedding specific information as electronic water- 
mark data into a portion having little effect on the image 
quality, such as LSB {Lease Significant Bit) of pixel data. 20 
However, even when the above method is used, it is stiil 
easy to remove the electronic watermark data from 
images. For example, the information of LSB of pixels 
would be lost if a low pass filter is used, and also the 
Image compression processing aims to reduce the total 2s 
data amount by omrtting theinformation-amotmt-of such 
a portion having little effect on image quality. Therefore, 
the electronic watermark data are lost by the image 
processing, and thus there is such a problem that it is 
difficult to re-detect the electronic watermark data. 30 
[001 4] A method of subjecting an image to frequency 
conversion and embedding electronic watermark data 
into an area where the frequency component of a video 
signal after the frequency conversion is strong has been 
also proposed as another example of the method of 35 
subjecting an image to frequency transformation by 
using a low pass filter ("Nikkei Electronics*, 1996. 4. 22 
(no. 66), p 13). According to this paper, as a method of 
installing ID information into a digital work, inherent ID 
information is installed every purchaser of a work (mov- 40 
Ing pictures, still pictures, photographs and sounds are 
targeted), and the ID information is used to expose 
works (publications, etc.) which were unjustly copied by 
persons other than the purchasers, and the electronic 
watermark data are embedded into the frequency com- 45 
ponents of the original works. Therefore, the electronic 
watermark data are not lost through the image process- 
ing-such as- compression processing; filtering or the like. 
Further, by using a normal distribution type random 
numbers as electronic watermark data, the interference so 
between the electronic watermark data is prevented, 
and the destruction of the electronic watermark data is 
made hard without having no effect on the overall 
image. 

[001 5] Fig. 7 shows the construction described in this ss 
paper. The method of embedding the electronic water- 
mark data according to the above method is as follows. 
First, an original image 701 is converted to frequency 



components by using DCT (Discrete Cosine Transfor- 
mation) 703. Data of n which show high amplitude in the 
frequency area are selected, and they are represented 
as follows: 

'(1). K2) f(n) 

w(1), w(2). ... w(n) of the electronic watermark data 701 
are selected from a normal distribution whose average 
and dispersion are equal to 0 and 1 respectively, and 
the following equation is calculated for each (i) in elec- 
tronic watermark data embedding means 704: 

FO)of(i) + ox|f(i)jxw(i) 

[0016] According to the electronic watermark data 
embedding means 704. the output (f(i)) of DCT 703 is 
multiplied by the electronic watermark data 702 (w(i)) in 
a multiplier 305, and the multiplication result (|f(i)|x w(i)) 
is multiplied by a scaling element a 706 in a multiplier 
707. The multiplication result (ax|f(i)|x w(i)) is added • 
with the output of DCT 7 in an adder 708 to obtain F(i). 
[0017] Finally, by inverse DCT (inverse Discrete 
Cosine Transform) 709, an output image 710 in which 
the electronic watermark data are embedded is 
obtained from the frequency components obtained by 
converting f(i) to F(i). 

[0018] Detection of the electronic watermark data is 
performed as follows. In this detection method, an origi- 
nal image 801 and electronic watermark data candi- = 

dates w(i) (i » 1 , 2 n) 809 must be known. 

[001 9] Referring to Fig. 8, a target image 802 contain- 
ing the electronic watermark data is converted to fre- 
quency components by using DCT 804 to obtain the 

following frequency components: F(1) t F(2) F(n). 

Further, the original image 801 is also converted to fre- 
quency components by using DCT 803 to obtain the fol- 
lowing frequency components: f(1), f(2) ( ... f(n). On the 
basis of f(i) and F(i) thus obtained, the electronic water- 
mark data estimation value W(i) is calculated and 
extracted according to the following equation (f(i) is sub- 
tracted from F(i) in a subtracter 806, and then the sub- 
traction result is divided by f(i)) in a divider 807) in the 
electronic watermark data detection means 805: 

W(i) = (F(0-f(i))/f(0 

Subsequently, statistical similarity C is calculated 
according to the following equation by using the vector 
inner product between the output W(i) of the electronic 
watermark data detection means 805 and the electronic 
watermark data w(i) in an inner product calculator 808: 



Here. 



C = Wxw/(WDxwD) 



W = (W(1), W(2) VY(n)), 
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w = (w(1), w(2) w(n)) 

WD » absolute value of vector W 

wD = absolute value of vector w 

Statistical similarity judgment means 810 judges that 
the electronic watermark data concerned are embed- 
ded rf the statistical similarity C is equal to or more than 
a specific value. 

[0020] If the electronic watermark data are embedded 
into an image by using the above method, this is effec- 
tive to a case where a copyright proprietor owing an 
original image carries out the detection processing on 
digital image data which seems to be unjustly copied. 
[0021] The above method needs the original image, 
and thus rt is effective to only the case where the copy- 
right proprietor owning the original image performs the 
detection processing on image da!a which seem to be 
unjustly copied, however, the reproducing device of 
each terminal cannot perform the detection processing 
of electronic watermark data because it has no original 
image. Therefore, a method obtained by improving the 
above method so that it is applicable to terminal 
processing, particularly an MPEG system has been pro- 
posed. 

[0022] Referring to Fig. 9, according to this improved 
methodran original image 901 is divided into blocks 902 
of 8 pixels x 8 pixels, and the embedding and extracting 
processing of electronic watermark data is performed 
by using the block 902 as a processing unit. 
[0023] Electronic watermark data embedding means 
905 performs the frequency conversion through MPEG 
coding processing by using DCT 903. The AC compo- 
nents in a frequency area are represented by f(1), f(2), 
.... f(n) in increasing order of frequency component. Fur- 
ther, the electronic watermark data 904: w(1), w(2) 

w(n) are selected from a normal distribution having an 
average of 0 and a dispersion of 1, and the following 
equation is calculated for each i in the electronic water- - 
mark data embedding means 905: 

F(i) « f(i) + a x avg(f(i)) x w(i) 

Here, a represents a scaling element, and avg(f{i)) rep- 
resents a partial average obtained by averaging the 
absolute points at three points in the neighborhood of 
f(i). Specifically. f(i) is subjected to partially averaging 
operation in a partial average unit 906, the partial aver- 
age is multiplied by the electronic watermark data w(0 ' 
904. the multiplication result avg(f(i)) x w(i) is multiplied 
by a constant a in a multiplier 909, and the multiplication 
result a x avg(f(i)) x w(i) is added with the output of DCT 
903 in an adder 910. f(i) is replaced by Ffj), and the sub- 
sequent processing of the MPEG coding processing is 
carried out The output F(i) of the electronic watermark 
data embedding means 905 is quantized according to a 
quantizing table 912 by a quantizer 91 1 and then coded 
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in a encoder 913 to obtain MPEG data. 

[0024] Subsequently, the detection of the electronic 

watermark data is carried out for the MPEG data by the 

following method. In the following detection method, no 

original image is needed, and it is sufficient that the 

electronic watermark data w(i) (i = 1, 2, ... n) has been 

known. 

[0025] Referring to Fig. 10, the MPEG data 1001 are 
decoded in a decoder 1002. and then inversely quan- 
tized in an inverse quantizer 1003 to be expanded. 
Therefore, the inversely quantized data are subjected to 
inverse discrete cosine transform in an inverse DCT unit 
1004 to obtain electronically watermarked image data 
1005. The image data thus obtained are supplied to a 
display unit, whereby a display image containing an 
electronic watermark is obtained. 
[0026] The electronic watermark data Ffj) in the fre- 
quency area of the block after the inverse quantization 
of the MPEG expansion processing is completed is rep- 
resented by F(1), F(2), ... F(n) in increasing order of fre- 
quency component The average value of the absolute 
values at three points in the neighborhood of F(i) is cal- 
culated as a partial average avg (F(i)) by a partial aver- 
age unit 1007, and then F(i) is divided by the partial 
average avg(F{i)) in a divider 1008 to obtain electronic 
data w(i) as follows: 

W(i) = F(i)/avg(F(i)) 

Further, the sum WF(i) of the W(i) values of one image 
is calculated as follows in an adder 1009: WF(i) = W(1) 
+ W(2) + ... + W(n), and the above sum is calculated for 
each (i). Subsequently, WF(i) and the electronic water- 
mark data w(i) 101 1 are input to an inner product calcu- 
lator 1010 to calculate the inner product therebetween, 
and the statistical similarity C is calculated by using the 
vector inner product as follows: 



Here, 



45 



C» WFxw/(WFDxwD) 

WF = (WF(1), WF(2) WF(n)) 

w* (w(1). w(2). ... w(n)), 
WFD = absolute value of vector WF 
wD = absolute value of vector w 



If the statistical similarity C is above a predetermined 
specific value, the statistic similarity judgment means 
1012 judges that the electronic watermark data con- 
cerned are embedded. 

[0027] Rg. 1 1 shows a detection method of electronic 
watermark data of an image after the MPEG expansion 
processing is completed. Image data 1101 are sub- 
jected to discrete cosine transform in a DCT unit 1 102, 



4 



14:53:40 



EP 0 957 637 A1 



8 



and the image data thus transformed are represented 
by ^0). F(2), ... F(n) in increasing order of frequency 
component in the frequency area of the image block by 
the electronic watermark data detection means 1103. 
The average value of the absolute values at three points 
is calculated as a partial average avg(F(i)) in a partially 
averaging unit 1104, and then the electronic watermark 
data W(i) is calculated as follows: 

W(i) = F(i)/avg(F(i)) 

Further, the sum WF(i) of W(i) of one image is calcu- 
lated every (i) in an adder 1 105. Subsequently, the sta- 
tistical similarity C between the electronic watermark 
data w(i) 1 106 and WF{i) is calculated according to the 
following equation by using the vector inner product in 
an inner product calculator 107: 



Here, 



CnWFx w/(WFD xwD) 

WF - (WF(1), WF{2) WF(n)). 

w = (w(1). w(2), ... w(n)), 
WFD « absolute value of vector WF 
wD a absolute value of vector w 



If the statistical similarity C is above a specific value, a 
statistical similarity judgment means 1109 judges that 
the electronic watermark data concerned are embed- 
ded. 

[0028] The electronic watermark data are detected 
from an image containing the electronic watermark data 
concerned and then the electronic watermark data con- 
cerned are subtracted from the image, whereby an orig- 
inal image can be obtained. In this case, any person 
other than the copyright proprietor can also obtain the 
original image by using this detection device, and thus 
the reproduction of the original image which is contrary 
to a copyright-proprietor's will is possible. Therefore, a 
further improved encryption technique or enhanced 
secrecy has been required. 

SUMMARY OF THE INVFIMTION 

[0029] Trie present invention has been implemented 
in view of the foregoing situation, and has an object to 
further enhance secrecy for original media such as an 
original image or the like, clarify a copy-prohibited range 
and provide an attribute to allow only copies which are 
subject to a copyright-proprietor's will. 
[0030] In order to attaint the above object, an image 
attribute altering device according to a first aspect of the 
present invention includes image attribute detection 
means for detecting an input image (attribute "a") and 
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the attribute of the input image, and image attribute 
altering means for altering the image attribute in the 
input image in accordance with the attribute detection 
result of the input image, whereby an output image 
(attribute "B") having a new attribute is output. 
[0031] Further, in order to attain the above object an 
electronic watermark embedding device according to a 
second aspect of the present invention includes dis- 
crete cosine transforming means for subjecting an input 
image to discrete cosine transform, electronic water- 
mark embedding means for inserting electronic water- 
mark data into the data obtained by the discrete cosine 
transforming means, electronic watermark detection 
means for detecting whether the electronic watermark 
data to be inserted by the electronic watermark embed- 
ding means have been already inserted in the input 
image, and selection means for make the input image 
through if it is detected by the electronic watermark 
detection means that the electronic watermark data has 
been already inserted in the input image, or embedding 
new electronic watermark data into the input image if it 
is detected by the electronic watermark detection 
means that any electronic watermark data has not yet 
been embedded in the input image. 

BRIEF DESCR1PTION-QF-THE DRAWINH^ 

[0032] 

Fig. 1 is a block diagram showing an image attribute 
altering device according to an embodiment of the 
present invention; 

Fig. 2 is a block diagram showing an image attribute 
detection device according to the embodiment of 
the present invention; 

Fig. 3 is a block diagram showing an image attribute 
altering device according to the embodiment of the 
present invention; 

Fig. 4 is a flowchart showing the operation of the 

image attribute altering device according to the 

embodiment of the present invention; 

Fig. 5 is a block diagram showing the image 

attribute altering device according to another 

embodiment of the present invention; 

Fig. 6 is a block diagram showing an electronic 

watermark data insertion device according to the 

embodiment of the present invention; 

Fig. 7 is a block diagram showing a conventional 

electronic watermark data insertion device; 

Fig. 8 is a block diagram showing a conventional 

electronic watermark detection device; 

Rg. 9 is a block diagram showing a conventional 

electronic watermark data embedding device; 

Fig. 10 is a block diagram showing-a conventional 

electronic data embedding device; and 

Fig. 1 1 is a block diagram showing a conventional 

electronic watermark data detection device. 
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DETAILED DFSP.RiP T fr ) N OF THE PRFpppq pn 
EMBODIMENTS 

[0033] Preferred embodiments according to the 
present invention will be described hereunder with refer- 
ence to the accompanying drawings. 

[First Embodiment] 

[0034] Fig. 1 is a block diagram showing an attribute 
alteration processing device according to a first errfcod- 
iment of the present invention. 

(0035J In Fig. 1, an input image 101 has an attribute 
"A* on the basis of electronic watermark data which are 
beforehand embedded in the input image 101. An is 
image attribute detection device 102 extracts the 
embedded electronic watermark data to detect an 
image attribute. That is. the input image 101 is input to 
the image attribute detection device 102 to detect the 
image attribute, thereby obtaining an attribute detection so 
result 103 (attribute "A"). The attribute detection result 
103 and the input image 101 are input to an image 
attribute altering device 104. The image attribute alter- 
ing device 104 alters the attribute and outputs an output 
image (attribute "B") having a new attribute. 2 s 
[0036] The image attribute altering device 104 exe- 
cutes the operation of altering the attribute ("a") of the 
image before the new electronic watermark data are 
inserted, and then obtaining the image having the new 
attribute ("B"). Accordingly, by defining the meaning of bo 
the attribute "A" as "copy is allowed only once" and 
defining the meaning of the attribute "B" as "copy pro- 
hibited', the image data whose attribute is altered to "B" 
are afterwards prohibited from being copied, thereby 
protecting the copyright. ^ 
[0037] Next, the construction of the image attribute 
detection device 102 of Fig. 1 will be described with ref- 
erence to Fig. 2. 

[0038] In Fig. 2, the input image 101 having the 
attribute ("A*) is converted to frequency components by 
DCT 201. In the frequency area, an electronic water- 
mark data estimated value is extracted in electronic 
watermark data detection means 202. The statistical 
similarity C between known electronic watermark data 
and the electronic watermark data estimated value is 
calculated to obtain an attribute detection result 103 of 
the Input image 1 0 1 . The detail construction is the same 
as the priorart shownwFig. 11, and rt™il:be-dBscrfced 
later. 

[0039] Here, a normal electronic watermark data 
inserting (embedding) method will be described with 
reference to Fig. 7. 

[0040] Referring to Fig. 7, an original image 701 is first 
converted to frequency components by using DCT (Dis- 
crete Cosine Transform) 703. Data of n which have high 
amplitude are selected in the frequency area, and they 

are represented as follows: f(1), f(2) f(n). 

[0041 ] Further, electronic watermark data w(1 ), w(2). 



... w(n) are selected from a normal distribution having 
an average value of 0 and a dispersion value of 1, and 
the following equation is calculated for each (i) in the 
electronic data embedding means 704: 

P(0 = f(i)+ax|f(i)|xw(i) 

Here, a represents a scaling element. Finally, by the 
inverse DCT (inverse Discrete Cosine Transform) 709 
the output image 710 in which the electronic watermark 
data are embedded is obtained from the frequency 
components obtained by replacing f(i) with F(i). In this 
embodiment electronic watermark data are inserted in 
a write-once style into an image in which electronic 
watermark data have been already inserted. 
[0042] In this embodiment, the operation of converting 
data to the frequency components (frequency area) 
through DCT which is normally earned out is omitted, 
and the data are directly inserted with being left time 
components (time area). The data to be inserted are 
substituted for a series of conversion such as DCT/elec- 
tronic watermark embedding/inverse DCT as shown in 
Fig. 6, and the electronic watermark data are inserted 
every pixel block. When the electronic watermark data 
to be inserted are converted to frequency components 
thTOugh-DCTf they-are set to data in a frequency area 
different-from that of the electronic watermark data 
which were previously embedded. 
[0043] Through the above operation, the electronic 
watermark data which are beforehand embedded into 
an image are additionally altered to change the result of 
the attribute detection based on the electronic water- 
mark data. Specifically, specific additive data are added 
to the signal calculated at the detection time to alter the 
result of the attribute detection. In this embodiment, a 
specific example of the internal construction of the addi- 
tive insertion method as described above will be 
described in more detail. 

[0044] Fig. 3 is a block diagram showing an image 
attribute altering device 104. 

[0045] In Fig. 3, the image attribute altering device 
104 has additive insertion data 301 and data "0" 302. 
The additive insertion data 301 are fixed data which are 
stored in ROM or RAM with being developed. Trie data 
"0" 302 have the same bit width as the additive insertion 
data 301 , and all the bit values thereof are equal to "0". 
These data are selected on the basis of the attribute 
detection result 103 by a selector 303 and supplied to 
an insertion data register 306 to hold data at a time. Trie 
additive insertion data 301 are selected when the 
attribute detection result 1 03 is equal to "1 " (the attribute 
of the input image 101 is "A"), and the data "0" 302 are 
selected when the attribute detection result 103 is equal 
to "0" (the attribute of the input image lor is a value 
other than "A"). 

[0046] Here, as ah example of the additive insertion 
data 301, three-dimensionafly arranged numerals of 8 x 
8 x k (k represents a natural number and it is an inherent 
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value to the system and called as "electronic watermark 
length") are added to one field or one frame. For exam- 
ple, one field or one frame is divided into 8x8 blocks, 
and a specific variable determinant of 8 x 8 is inserted 
to all the blocks or some of the blocks. The insertion 5 
data 301 of the electronic watermark length indicated in 
the specific variable determinant corresponds to the 
attribute "B", and it means "copy prohibited (impossi- 
ble)-. 

[0047] The image attribute altering device 104 of this 10 
embodiment includes a color difference register 304 for 
holding color difference signal/brightness signal input 
from the input image 101, and a brightness register 305. 
These registers holds the color difference signal/bright- 
ness signal from the input image 101 at the same time is 
when the data are stored in the insertion data register 
306. 

[0048] For the data thus held, an adder 307 provided 
in this embodiment adds the data held in the brightness 
register 305 and the data held in the insertion data reg- 20 
ister 306. Here, if the data selected on the basis of the 
attribute detection result 103 by the selector 303 corre- 
spond to the data "0" 302, the data to be additively 
inserted as a result is equal to "0", and the attribute is 
not altered. That is. when the attribute of the input 25 
image 101 is an attribute other than "A", the attribute of 
the output image 105 is not "B". That is, the attribute of 
the output image 105 is not *B" when the attribute of the 
input image 101 is an attribute other than "A". 
[0049] When the data selected on the basis of the 30 
attribute detection result by the selector 303 are the 
additive insertion data 301, the data to be additively 
inserted as a result correspond to the additive insertion 
data 301. The additive insertion data 301 held in the 
insertion data register 306 are added with the data held 3S 
in the brightness register 305 by the adder 307 to obtain 
a brightness signal, and the brightness signal obtained 
by inserting the additive insertion data 301 into the 
brightness components of the input image having the 
attribute "B" is held in the brightness register 309. 40 
[0050] The data thus obtained are held as new bright- 
ness data in the brightness register 309. In this case, 
the contents of the brightness register 305 and the 
brightness register 309 are coincident with each other. 
IF the data of the insertion data register 306 is not equal 45 
to "0", the data has a different attribute "B". 
[0051] Further, in order to keep thB data at the same 
time, the data held in the color difference register 304 is 
directly supplied to and held in the color difference reg- 
ister 308. In this case, the color difference register 304 so 
and the color register 308 are common. 
[0052] The data in the brightness register 309 and the 
data in the color difference register 308 which are held 
at the same time output as image data having a new 
attribute to an output image 105. That is, if the original ss 
vnput image has the attribute "A", the image data con- 
taining the additive insertion data in addition to the 
attribute "A" becomes image data having the attrbute 



"B". 

[0053] In Fig. 3. in the case where the input image 101 
is the overall frame image data, the adder 307 can eas- 
ily add the additive insertion data into the input image if 
the additive insertion data is inserted into VBI which is a 
part of the input image. In the case where the input 
imag e 1 01 is image data of a block of p pixels x p pixels, 
the adder 307 can detect the block and add the additive 
insertion data if the additive insertion data are the data 
in the same area as the p pixels x p pixels. 
[0054] The operation of this embodiment will be 
descrfoed. First the operation of the image attribute 
altering device 104 of this embodiment will be described 
with reference to a timing charge of Fig. 4. 
[0055] First the following conditions are assumed. . 
That is, (a) an input color difference signal and (b) an 
input brightness signal are input from the input image 
101. and at the same time (c) additive insertion data 
301 are settled, (d) data "0" 302 are equal to "0" at -all 
times. At the same time, (e) the value of an attribute 
detection result 103 is also input Here, (c) the additive 
insertion data 301 are selected when (e) the value of 
the attribute detection result 103 is equal to "1". and (d) 
the data "0" 302 are selected when the value of the 
attribute detection result 103 is equal to "0". At the clock 
periods CL1 , CL2, (c) the additive insertion data 301 are 
equal to "SO", "S1". and (e) the value of the attribute 
detection result 103 is equal to "1", "1". 
[0056] At a next time (the rise-up time of a next clock 
in clock synchronization), (f) the color difference register 
304 receives the input color difference signal, (g) the 
brightness register 305 receives the input brightness 
signal. Further, (h) the insertion data register 306 
receives (c) the value of the additive insertion data 301 
selected in (e) the attribute detection result 103 or (d) 
the data "0" 302. Specifically, at the clock periods CL2, 
CL3, (0 the value of the color difference register 304 is 
equal to "CO", "C1", (g) the value of the brightness reg- 
ister 305 is equal to "Y0\ "Y1\ and (h) the value of the 
insertion data register 306 is Bqual to "SO", "S1 ". 
[0057] At a next time, (I) the color difference register 
308 receives (0 the value of the color difference register 
304. and (j) the brightness register 309 holds the addi- 
tion result of (g) the value of the brightness register 305 
just before and (h) the value of the insertion data regis- 
ter 306. 

[0058] At a next time. (I) the signals of the color differ- 
ence register 308 and (j) the brightness register309 are 
output as a composite image signal (output image 105). 
[0059] Specifically, at the clock periods CL3, CL4, (i) 
the color difference register 308 is equal to "CO", "C1". 
and 0) the brightness register 309 is equal to "Y0+S0", 
"Y1+S1". As a result, the output image is equal to 
"C0+Y0+SO", "C1+Y1+SV. These correspond to the 
above attribute "B\ At the clock period CL5, (I) the color 
difference register 308 is equal to "C2\-.and (j). the 
brightness register 309 is equal to "Y2\ As a result the 
output image is equal to "C2+Y2* and the attribute "A" is 
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output at a next time. 

[0060] Consequently, when an image of the attribute 
"A" containing electronic watermark data is continu- 
ously input as an original image, the same image having 
the attribute "A" is continuously output On the other 5 
hand, when an image of the attribute "A" containing 
electronic watermark data is discontinuously input, the 
same image having the attribute "A" is discontinuously 
output and also an image of the attribute "B" is output 
to an empty image portion thereof. 10 
[0061 J As described above, the output image 105 
(attribute "B") is generated from the input image 101 
(attribute "A). However, as described above, when the 
data 0" 302 are selected by the selector 303, the origi- 
nal data are output with no alteration, that is. the is 
attribute is not altered. 

[0062] In the above embodiment, the attribute detec- 
tion result is extracted from the input image at least 
every frame, and the additive insertion data are inserted 
as electronic watermark data on the basis of the result. 20 
However, the attribute detection result may be extracted 
from only a specific block of the input image to insert the 
electronic watermark data into the block concerned. 
Besides, the input image is divided into plural blocks, 
the attribute detection result is extracted from each 25 
block, H is judged every block whether the additive inser- 
tion data of electronic watermark data should be 
inserted or not, and the additive insertion data is 
inserted into any block in which no electronic watermark 
data is inserted. In this case, any block has the attribute 30 
"A" and the attribute "B", and not only secrecy, but also 
permission or prohibition of copy can be easily 
detected. 

[Second Embodiment] 35 

[0063] The construction of the second embodiment of 
the present invention is basically the same as the first 
embodiment except for the input image. The construc- 
tion of the second embodiment will be described with 40 
reference to Fig. 5. 

[0064 J In Fig. 5, the input image 101 having the 
attribute "A" is input as an analog (composite) signal, 
however, the subsequent processing after the input of 
the Input image 101 may be the same as the first 45 
embodiment by using an A/D (analog-to-digital) con- 
verter 501. Further, for the output image 105, the image 
output having the attribute "B" can be obtained as an 
analog (composite) signal by the same construction as 
the first embodiment if the digitally-processed image so 
data are converted to an analog (composite) signal by 
using a D/A (digital-to-analog) converter 502 as in the 
case of the input image. 

[0065J It is needless to say that the NO converter 501 
at the input stage and the D/A converter 502 at the out- 55 
put stage may be used at the same time or not at the 
same time. 

[0066] According to this method, the adaptive insertion 



of electronic watermark data can be performed in the 
attribute altering method of analog images, and thus the 
copyright of analog images can be protected. 
[0067] Trie alteration of the attribute in this embodi- 
ment is earned out on the assumption that an original 
media work has an attribute "AAA", a work in which first 
electronic watermark data are inserted is altered to an 
attribute "B" and a work in which second electronic 
watermark data are additively inserted is altered to an 
attribute "CCC\ and it is not carried out to inquire about 
whether a work is the original or not 
[0068] As described above, the attribute is altered by 
applying the electronic watermark data, so that the 
image thus obtained is an image in which electronic 
watermark data are inserted. 

[0069] Accordingly, by providing an equipment side 
with means of detecting the attribute, unjust copies of 
digital images can be prevented. 
[0070] Further, according to this embodiment, the 
selection based on the selector is adopted, so that the 
attribute is allowed not to be altered for some specific 
input images. 

[0071] In addition, the insertion of the additive inser- 
tion data is performed by sequentially inserting the addi- 
tive insertion data into the input image, and thus there is 
an effect that the output image can be obtained on a 
real-time basis. 

[0072] Further, for example, when the meaning of the 
attribute "A" is set to "copy is allowed only once", and 
the meaning of the attribute "B" is set to "copy is prohib- 
ited", the image data whose attribute is altered to the 
attribute "B" is prohibited from being afterwards copied, 
and the copyright can be protected. 
[0073] Although, the present invention has been 
shown and described with respect to best mode embod- 
iments thereof, it should be understood by those skilled 
in the art that the foregoing and various other changes, 
omissions, and additions in the form and detail thereof 
may be made therein without departing from the spirit 
and scope of the present invention. 

Claims 

1 - Anlmage attribute altering device comprising: 

image attribute detection means (102) for 
detecting the attribute of an input image (101) 
(attribute -A"); and- 

imag e attribute altering means ( 1 04)for altering 
the image attribute in the input image (101) on 
the basis of the attribute detection result (103) 
of the input image, thereby outputting an output 
image (105) having a new attribute (attribute 
-B-). 

2. The image attribute altering device as claimed in 
claim 1, wherein the attribute is electronic water- 
mark data, and the attribute detection result of the 
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output image (105) is output every frame of the 
image signal. 

3. The image attribute altering device as claimed in 
claim 1, wherein said image attribute detection 5 
means (102) includes first DCT means (201) for 
converting the input image (101) to image fre- 
quency components through discrete cosine trans- 
form, second DCT means for converting an original 
image to original frequency components through to 
discrete cosine transform, and means for subtract- 
ing the original frequency components from the 
image frequency components and dividing the sub- 
traction result by the image frequency component 

to detect electronic watermark data. js 

4. The image attribute altering device as claimed in 
claim 1, wherein the inner product between the divi- 
sion result of said image attribute detection means 
(102) and electronic watermark data (205) is calcu- 20 
fated, statistical similarity is extracted on the basis 

of the calculation result, and if the statistical similar- 
ity is above a predetermined value, it is judged as 
an attribute detection result that an electronic 
watermark is inserted inthe input image (101). 25 

5. The image attribute altering device as claimed in 
claim 1, wherein said image attribute altering 
means (104) includes a selector (303) for judging 
whether the input image (101) is added with elec- 30 
tronic watermark data to be additively inserted or 
directly output without being altered, and an adder 

for adding the output of the selector (303) and the 
brightness signal of the input image (101). 

35 

6. The image attribute altering device as claimed in 
claim 2, wherein said image attribute detection 
means (102) includes first DCT means (201) for 
converting the input image (101) to image fre- 
quency components through discrete cosine trans- 40 
form, second DCT means for converting an original 
image to original frequency components through 
discrete cosine transform, and means for subtract- 
ing the original frequency components from the 
image frequency components and dividing the sub- 45 
traction result by the imagB frequency component 

to detect the electronic watermark data. 

7. The image attribute altering device as claimed in 
claim 2, wherein the inner product between the divi- so 
sion result of said image attribute detection means 
(102) and the electronic watermark data is calcu- 
lated, statistical similarity is extracted on the basis 

of the calculation result, and if the statistical similar- 
ity is above a predetermined value, it is judged as 55 
an attribute detection result that an electronic 
watermark is inserted in the input image. 



8. The image attribute altering device as claimed in 
claim 2, wherein said image attribute altering 
means (104) includes a selector (303) for judging 
whether the input image (101) is added with the 
electronic watermark data to be additively inserted 
or directly output without being altered, and an 
adder for adding the output of the selector (303) 
and the brightness signal of the input image (101). 

9. The image attribute altering device as claimed in 
claim 2, wherein the inner product between the divi- 
sion result of said image attribute detection means 
(102) and the electronic watermark data is calcu- 
lated, statistical similarity is extracted on the basis 
of the calculation result and if the statistical similar- 
ity is above a predetermined value, it is judged as 
an attribute detection result that an electronic 
watermark is inserted in the input image. 

10. The image attribute altering device as claimed in 
claim 2, wherein said image attribute altering 
means (104) includes a selector (303) for judging 
whether the input image (101) is added with the 
electronic watermark data to be additively inserted 
or directly output without being altered, and an 
adder for adding the output of the selector (303) 
and the brightness signal of the input image (101). 

11. The image attribute altering device as claimed in 
claim 2, wherein a meaning of the image attribute is 
one of "copy is allowed only one", "copy prohibit", 

. and "copy no-prohibit*. 

12. An electronic watermark embedding device com- 
prising: 

discrete cosine transform means (201) for sub- 
jecting an input image (101) to discrete cosine 
transform; 

electronic watermark detection means (202) for 
detecting whether electronic watermark data to 
be inserted by an electronic watermark embed- 
ding means have been already inserted In the 
input image (101); 

electronically embedding means for inserting 
electronic watermark data into input image 
data converted by the discrete cosine trans- 
form means; and 

selection means for directly outputting the input 
image with no modification when it is detected 
by said electronic watermark detection means 
(202) that the electronic watermark data has 
been inserted in the input image, or embedding 
new electronic watermark data: into the input 
image when the insertion of the electronic 
watermark data is not detected. 

1 3. The electronic watermark embedding device as 
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claimed in claim 11, wherein said electronic water- 
mark detection means (202) performs the following 
operations: on the assumption that the original 
image and electronic watermark data candidates 
w(i) (i = 1, 2, ... n) are known, an image containing $ 
electronic watermark data is subjected to orthogo- 
nal transform to be converted into frequency com- 
ponents as f(1).f(2), „f(n); representing the values 
of elements corresponding to the frequency compo- 
nents containing the electronic watermark data in 10 
the frequency area by F(1), F(2) F(n), the elec- 
tronic watermark data W(i) is calculated and 
extracted on the basis of f(i) and F(i) according to 
the following equation: 

W(i) = (F(0 - f(i))/f(i): 

the statistical similarity C between w(i) and W(i) is 
calculated and extracted by using vector inner prod- 
uct according to the following equation: 20 

C« W - w/(WDxwD), 

Here. 

25 

W=>(W(1), W(2)..„, w(n)) t 

w « (w(1), w(2) w(n)) ( 

WD a absolute value of vector W 30 
wD = absolute value of vector w' 
" • " represents inner product; 

35 

when the statistical similarity C is above a predeter- 
mined value, it is detected that the electronic water- 
mark data have been embedded in the image. 
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